A variational approach to robust Bayesian interpolation

نویسندگان

  • Michael E. Tipping
  • Neil D. Lawrence
چکیده

We detail a Bayesian interpolation procedure for linearin-the-parameter models which combines both effective complexity control and robustness to outliers. Robustness is obtained by adopting a Student-t noise distribution, defined hierarchically in terms of an inverse-Gamma prior distribution over individual Gaussian observation variances. Importantly, this hierarchical definition enables practical Bayesian variational techniques to concurrently determine both the primary model parameters and the form of the noise process. We show that the model is capable of flexibly inferring, from limited data, both Gaussian and more heavily-tailed Student-t noise processes as appropriate.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Development of a Model for Locating Hubs in a Competitive Environment under Uncertainty: A Robust Optimization Approach

This article explores the development of previous models to determine hubs in a competitive environment. In this paper, by comparing parameters of the ticket price, travel time and the service quality of hub airports, airline hubs are divided into six categories. The degree of importance of travel time and travel cost are determined by a multivariate Lagrange interpolation method, which can pla...

متن کامل

Rényi Divergence Variational Inference

This paper introduces the variational Rényi bound (VR) that extends traditional variational inference to Rényi’s α-divergences. This new family of variational methods unifies a number of existing approaches, and enables a smooth interpolation from the evidence lower-bound to the log (marginal) likelihood that is controlled by the value of α that parametrises the divergence. The reparameterizati...

متن کامل

Variational Inference with Rényi Divergence

This paper introduces the variational Rényi bound (VR) that extends traditional variational inference to Rényi’s α-divergences. This new family of variational methods unifies a number of existing approaches, and enables a smooth interpolation from the evidence lower-bound to the log (marginal) likelihood that is controlled by the value of α that parametrises the divergence. The reparameterizati...

متن کامل

Variational Gaussian Process Classiiers

Gaussian processes are a promising non-linear interpolation tool (Williams 1995; Williams and Rasmussen 1996), but it is not straightforward to solve classiication problems with them. In this paper the variational methods of Jaakkola and Jordan (1996) are applied to Gaussian processes to produce an eecient Bayesian binary classiier.

متن کامل

A Variational Bayes Approach to Robust Principal Component Analysis

We solve the Robust Principal Component Analysis problem: decomposing an observed matrix into a low-rank matrix plus a sparse matrix. Unlike alternative methods that approximate this l0 objective with an l1 objective and solve a convex optimization problem, we develop a corresponding generative model and solve a statistical inference problem. The main advantages of this approach is its ability ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2003